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[57] ABSTRACT 

A method of detecting motion vectors within a predeter- 
mined search range for motion-compensation predictive 
coding is disclosed. The method includes the steps of 
searching for first motion vectors between two frames which 
are separated from each other in a time dimension by a first 
frame distance, selecting a second frame distance of two 
frames between which picture motion is represented by 
second motion vectors, making a check whether the prede- 
termined search range covers a predetermined percentage of 
the second motion vectors, the check using the first motion 
vectors as estimates of the second motion vectors after 
compensation for a difference between the first frame dis- 
tance and the second frame distance, and deciding, based on 
results of the check, whether to increase a frame distance for 
prediction. 
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METHOD AND DEVICE FOR DETECTING 
MOTION VECTORS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 
The present invention generally relates to motion-vector 

search methods, and particularly relates to a motion-vector 
search method used for inter-frame predictive coding of 
image information. 

Imagc-information-comprcssion coding schemes in elude 
internationally-staDdardizcd H.261 and H.262. MPEG1 
(moving picture experts group 1) and MFEG2 (moving 
picture experts group 2) among others. These compression 
coding schemes employ various compression processes such 
as DCT (discrete cosine transform) motion-compensation 
inter-frame prediction, etc. Effective enhancement of these 
compression processes is expected to bring about an 
improvement in overall compression rates of these schemes. 

2. Description of the Related Art 
bnage-informaUon-compression coding schemes include 

Inter-frame predictive coding which draws on redundancy in 
a time dimension to achieve compression. In using this 
intcr-frame predictive coding MPBG1 and MPEG2 can 
handle both a forward prediction and a backward prediction. 
The forward prediction detects changes between a previous 
frame and a current frame, and generates the current frame 
based oh the previous frame. 

FIG. 1A is an illustrative drawing far explaining the 
forward prediction. 

As shown in FIG. 1A. picture movement between a 
current frame, which is to be forwardly predicted, and a 
reference frame (previous frame) is detected within a pre- 
determined range defined for motion-vector search. Then, 
parts of the picture showing no movement are provided with 
zero morion vectors, and parts of the picture showing some 
movement are provided with corresponding motion vectors. 
These motion vectors are used for coding. 

FIG. IB is an illustrative drawing for explaining the 
motion-vector search. As shown in FIG. IB. a given frame 
is divided into a plurality of blocks B B* . Each of these 
blocks is separately subjected to subsequent DCT and quan- 
tization processes. In a motion-vector-search process, a 
given block B N of a forwardly-predicted frame is searched 
for in the reference frame within the inotioD-vector-search 
range. Namdy. a block B' N having the highest correlation 
with the block B* is detected within the motton-vector- 
scarch range of die reference frame. As shown in FIG. IB. 
movement of the block B N is then represented by a motion 
vector At subsequent stages, a differential between the 
block B^and the block B'yy is obtained by aligning these two 
blocks, and is subjected to the DCT and quantization pro- 
cesses. Results thus obtained and the motion vector M* are 
transmitted, stored, etc., as a pan of coded pictures. The 
same processes are applied to all the blocks shown in FIG. 
IB 

In the forward prediction of FIG. 1A. the larger the 
motion-vector-search range, the longer the detectable 
motion displacement, thereby providing higher compression 
rates. However, a larger motion- vector- search range requires 
a longer processing time. 

A bidirectional prediction generates the current frame 
based on a previous frame (past frame) and a subsequent 
frame (future frame). FIG. 2 is an illustrative drawing for 
explaining the bidirectional prediction. As shown in FIG. 2. 
the current frame is coded by using a backward motion 


2 

vector and a forward motion vector which are obtained 
based on a backward reference frame and a forward refer- 
ence frame. Assuming the same motion-vector-search-range 
size, the directional prediction has a higher prediction effi- 
5 ciency than does the forward prediction. Since the direc- 
tional prediction suffers from twice the processing load, 
however, it is a general practice to reduce the size of die 
motion- vector-search range by half for flic directional pre- 
diction. 

io Pictures coded based on the forward prediction are called 
P-picturcs (predictive pictures), and pictures coded based on 
the directional prediction are called B-pictures bidirection- 
ally predictive pictures). Also, pictures coded by infra-frame 
coding are called I-pictures (intra pictures). MPEG1 and 

J 5 MFEG2 employ a coding scheme which combines the 
intra-framc coding, the forwards-predictive coding, and the 
directionally-predictive coding together, so that a picture 
sequence can be represented as D3BPBBPBB . . . 
B3BPBBPBBP for example. 

20 In the inter-frame predictive coding of the related art. a 
fixed inter-frame distance is used for motion-vector search. 
(The inter-frame distance refers to a time distance between 
frames.) When an inter-frame distance is short for the 
forward prediction and the motion-vector-seaTch range is 

25 relatively large, for example, some motion-vector-search 
process is likely to be wasted by searching in excess of a 
maximum range of actually existing picture motions. Also, 
the mter-frame predictive coding of the related art uses a 
fixed number of bidirecricmally-premctive-coded frames. An 

30 increase in the number of these frames may result in a 
situation where the motion-vector-search range for the for- 
ward prediction is not sufficiently large. In this case, die 
prediction efficiency is decreased. 

35 Accordingly, there is a need for a motion- vector-search 
method which enhances prediction efficiency by optimizing 
an inter-frame distance for the motion- vector search in 
accordance with picture characteristics, 

SUMMARY OF THE INVENTION 

Accordingly, it is a general object of the present invention 
to provide a motion-vector-search method which can satisfy 
the need described above. 

It is another and more specific object of the present 

45 invention to provide a motion-vector-search method which 
enhances prediction efficiency by optimizing an inter-frame 
distance for the motion-vector search in accordance with 
picture characteristics. 
In order to achieve the above objects according to the 

so present invention, a method of detecting motion vectors 
within a predetermined search range for motion- 
compensation predictive coding is disclosed. The method 
includes the steps of searching for first morion vectors 
between two frames which are separated from each other in 

55 a time dimension by a first frame distance, selecting a 
second frame distance of two frames between which picture 
motion is represented by second motion vectors, making a 
check whether the predetermined search range covers a 
predetermined percentage of the second motion vectors, the 

6o check using the first motion vectors as estimates of the 
second motion vectors after compensation for a difference 
between the first frame distance and the second frame 
distance, and deciding, based on results of the check, 
whether to increase a frame distance for prediction. 

65 In the method described above, whether a sufficient 
motion-vector-search range can be maintained under an 
increased frame distance (second frame distance) is decided 
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based on the motion vectors obtained under a current frame 
distance (first frame distance). Based on this decision, the 
frame distance is subjected to an increase to have a larger 
number of bidjfecuonalfy predictive pictures, thereby 
enhancing the prediction efficiency. Therefore, this method 
achieves an inter-frame predictive coding which optimizes 
an inter-frame distance for the motion-vector search In 
accordance with picture characteristics. 

Other objects , and further features of the present invention 
will be apparent from the following detailed description 
when read in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1A is an illustrative drawing for explaining a forward 
prediction; 

FIG. IB is an illustrative drawing for explaining a motion- 
vector search; 

FIG. 2 is an illustrative drawing for explaining a bidirec- 
tional prediction; 

FIG. 3 is an illustrative drawing for explaining a principle 
of the present invention; 

FIG. 4 is an illustrative drawing showing a forward 
prediction according to the present invention; 

FIG. 5 is a flowchart of a process of changing an inter- 
frame distance according to an embodiment of the present 
invention; 

FIG. 6 is an illustrative drawing for explaining a check on 
a motion-vector-search range of a bidirectional prediction 
according to the present invention; 

FIG. 7 is an illustrative drawing for explaining another 
check on a modon-vecter-seaich range of the bidirectional 
prediction according to the present invention; 

FIG. 8 is a block diagram of an embodiment of an image 
processing device according to the present invention; and 

FIGS- 9A through 9F are table charts for explaining the 
reason why the inter-frame distance should start from a 
possible ro* T i TT " ITn riiFtarwr. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

In the following, a principle and embodiments of the 
present invention will be described with reference to the 
accompanying drawings. 

FIG. 3 is an illustrative drawing for explaining the prin- 
ciple of the present invention. In FIG. 3. frames O and Fj~F 6 
arc temporary successive frames. When the frame F 2 is to be 
forwardly predicted based on the current reference frame O. 
the frame F A is a frame to be bidirectionally predicted based 
on the frames O and F 2 . When time comes for a motion- 
vector search of the frame F 2 to be started the frame F 4 is 
men the frame to be forwardfy predicted using the frame F 2 
as a reference frame. At this time, the frame F 3 is bidirec- 
tiooalfy predicted using the frames F 2 and F 4 as reference 
frames. Likewise, the frame F 6 will be a frame to be 
forwardfy predicted using the frame F 4 as a reference frame, 
and the frame F 5 will be bidirectionally predicted based on 
the frames F 4 and F 6 . 

Assume that a change in a coding scheme is made such 
mat the frame F, currently scheduled for the bidirectional 
prediction will be forwardly predicted based on the frame F 3 
after this change. Also, assume that this change must be 
made without a decline in the prediction efficiency. When 
such a change is possible, the frame F 4 becomes a frame to 
be bidirectionally predicted based on the frames F 3 and F 3 . 


4 

Moving pictures tend to have little change in motion char- 
acteristics between frames within a short time range. This 
tendency provides a reasonable assumption that motion- 
vector characteristics detected between the frames F 5 and F 2 

5 are similar to those detected between the frames F 3 and O. 
Thus, an evaluation as to whether a sufficient range is 
provided far motion-vector search between the frames F 3 
and F 2 can be made by looking into the frames F 3 and O. 
In FIG. 3 x.3 and x n are boundaries to define a 

io motion-vector-search range used when the frame F 3 is 
forwardly predicted based on the frame O. Although a 
motion-vector-search range is actually a two-dimensional 
range-spreading in horizontal and vertical directions only 
one dimension, either horizontal or vertical, is used in 

15 explanation for the sake of simplicity. That is. x^j and x i3 
denote either horizontal boundaries or vertical boundaries. 
Then, a horizontal or vertical component x of a motion 
vector, detected between the frame F 3 and the frame O. 
should satisfy x^okx 13 in order to make an appropriate 

so forward prediction for the frame F 3 based on the frame O. 
In FIG. 3. x., and x 12 define a range within which motion 
vectors detected between the frame F 2 and the frame O are 
contained. This range is used for checking whether the 
boundaries x^ and x 13 are appropriate for forward prcdic- 

25 tion of the frame F 3 . 

Based on an assumption that motions in pictures do not 
have abrupt speed changes in a short tune period, the' 
boundaries and x 13 should be equivalent to the bound- 
aries x.,2 and x 12 after compensation for a frame-distance 
difference. Taking into consideration the inter-frame 
distances, the boundaries x^ and x u and the boundaries x„ 2 
and x 12 should be related as: 

Strictly speaking, all the motion vectors do not possibly fall 
into the above range. Namely, the boundaries x^ and x 12 
shown as a hatched region in FIG. 3 include most of the 

40 motion vectors but not all of them. 

When a ratio of the number of the motion vectors satis- 
fying x^<x'<x | 2 to the total number of motion vectors 
exceeds a predetmnincd threshold the boundaries x^ 2 and x 
, 2 are regarded as an appropriate range. Enlarged in propor- 

45 tion to the inter-frame distance, the boundaries x^, and x „ 
shown by dashed lines in FIG. 3 include the motion vectors 
by approximately the same ratio. Since the motion-vector- 
search range defined by the boundaries x^ and x 13 can be 
regarded as appropriate, it is fair to assume that the same 

30 motion-vector-search range is sufficient for motion-vector 
search between the frames F 3 and F^ 

In this manner, when the above-mentioned ratio exceeds 
a certain threshold, the frame F 5 can be forwardly predicted 
by using the frame F 3 as a reference frame. 

35 There are cases in which the above ratio does not exceed 
the prcc^ermined threshold. II is possible that, even under 
this condition, the motion-vector-search range is still appro- 
priate to maintain the current coding scheme. On the other 
hand, when the current motion -vector-search range is insuf- 

60 ficicnt even for the current coding scheme, a larger motion- 
vector-search range would have to be arranged in order to 
avoid a decline in prediction efficiency. Distinction between 
these two cases can be made by pixel-to-pixel differentials 
between original pictures and predicted pictures created 

65 based on motion vectors. 

When the motion-vector-search range is ascertained to be 
insufficient an inter-frame distance for the forward predic- 
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tion is shortened to have a forward prediction between the At the step S4 when the accumulated differential E is 

frames F 3 and F 2 . thereby reg ainin g a sufficient morion- below the predetermined range, a ratio of the motion vectors 

vector-search range. When the motion-vector- search range having a component x satisfying: 
is ascertained to be sufficient but not enough to satisfy the 

required condition between the above ratio and the prede- 5 K**ijytJMr«»«tf x^iM*)] (4) 

terminal threshold, a forward prediction is made between tA ^ . ^ . . . t . , _ . 

the frames F 4 and F 2 as originally scheduled. * * Ac ^ n vectors detected between the frame F a and 

» . ^ ^ , ^ , the frame O is obtained. 

to this manner, at the tune when a motion-vector search *7 . , . . it 

for the frame O is finished, a decision can be made whether L $ ^ { """J* 

to have a next forward paction between the frames F 3 and to * pTc6e ^ T ^ U P™*^ 8J« to 

F 2 , between the frames F 4 and F„ or between the frames F 3 8 ^j** P*^^ ««» to * ste P »• 

and F r When a scene cringe occurs in pictures, however! „ M * c s £> S6 ' ^ ^t, ^ ™ 

this decision which is made as described above, becomes ? +a far "b"*** forward predictions. (The inter-frame 

invalid To cope with this situation, a reliability measure of J 5 * 00 * " mcrca3ed to 3 according to the conditions set at 

the evaluation made on the motion-vector-search range is C A ?5P ~7 c _ , .... , , . , 

between the frames F 2 and O is obtained. Namely. pixel-To- ^ At *e step S8 when the ratio is below the predetermined 

pixel differentials between the frames F 2 and O are obtained, thrcsh °, 1 ^ a *<^»™de whether an accumulated pael- 

and are added for all pixels to provide an accumulated "J"* 0 aforwardl^dictea^frame-F, 

differential. When this accunnuVUed differential exceeds a ^ * C framC ° t3ieccds t a predetermined amount If 

predetennined amount, no change i 5 made to the inter-frame 20 tbepr<)ce^ 

distance inter-frame distance N at 2. If the accumulated differential 

FIG. 4 is an illustrative drawing showing a forward exce ^ 8 P rcdclcnnlDcd amotJDt> P roccdurc ^ to 8 

prediction according to the present invention. In FIG. 4, the StC ? k ? ™ ... . ^_ 

forward prediction is generalized by using Integers N and M. „ * * c S9 ' ^tex-frame distance is decreased to 

A frame F N is a N-th frame when framesar? successively 25 for Pactions. (The mter-frame 

counted from the frame O, and, likewise, a frame F w is a ^^ crcascd to 1 according to the conditions set at 

M-th frame. Currently, a forward prediction is made for the ~ St ^P , , _ . 

frame F„ by using the frame O as a reference frame. Then. ra f nncr ' wh ^^ a sufficient moti^vector-search 

a check is made whether the rnoti^-veetor-search range is J** 5 ^ *? "^f** M mcrca5ed m, ^ framc 

sufficient for the frame F^ to use the frame 0 as a reference 30 ^Tf " dex^ded based 00 &e motion vectors obtained 

frame. This check is made based on results which are !™ * c fo ^ Vard P^^ 0IL J*** 1 011 ^ &c 

obtained from the motion-vector search at the frame F„ v***mt mstonceis subjected to an increase or a decrease 

Under an assumption that no abrupt change is preset in * P^ictive coding responsive to 

picture mwfcTaforward preSfeie fn**F M ^'^^Z^T^t^ rf ■ ■ 

requires a motion-vector component x detected between the js ^0 * " an illustrative drawing for explaining a check on 

frame F„ and the frame O tosatisfy- a roouc>o- vector-search range of a bidjrectional prediction 

according to the present invention. The same as in FIG. 4. a 

f(*-W*0<*<i(*'*.t,y*fl 0) forward prediction is currently made for the frame F„ by 

where x M and x^ are boundaries to define the motion- ™?* ^ ma ^ O, vvhich is j^ovided N-frames 

vector-search range used between the frame F„ and the « ^ in a time duncnsioii. Also a backward prediction of 

q the frame B„ for the bidirectional prediction is made based 

Namely, assuming no abrupt change in picture motion, a ™ £ ^ ^^^^^^'^ ^ f °J 
forward prediction of the frame F^ based on the reference ^ frame F^. a check is made whether a sufficient backward 
frame O can be made, if motion vectors detected between ^^I^ ^^i! " ^^^J 01 *\ bvSil *? 
the frame F„ and the frame O satisfies the Inequality (3) in 45 ^F^™<* *<Jn™ B even when the forward- 
a sufBcient number so that a ratio of such motion vectors to Prediction is ™ade for the frame F^. 
ail the motion vectors exceeds a F edcterniined threshold. In .^ nd ^^ um P b 1 ^ n *f 1 ™<*™1* « Fesent in 

this manner an enhancement of the prediction efficiency can m£ ^° ^kward ruction of the frame B n based 

be achieved. on the frame F v requnxs a motion-vector component x 

FIG. 5 is a flowchart of a process of changing the 50 detec * e ^ between the frame and the frame O to satisfy: 

inter-frame distance according to an ernbodiment of the W+ l MV*yfr4fft* m #(M-*)) (5) 
present invention. 

At a step SI. an inter-frame distance N for the forward where jl m and x^ are boundaries to define the backward 

prediction between the reference frame O and a predicted motioD-vector-search range used between the frame B„ and 

frame is set to 2. and an mter-frame-dlstance increment a is 55 the frame F^ Here, N in the inequality (5) is the inter-frame 

set to I. distance between the frame F^ and the frame O. and (M-n) 

At a step SZ motion vectors are searched for between the is the mter-frame distance between the frame F M and the 

frame O and the frame F^ frame That is. the range defined by the inequality (5) is 

At a step S3, a check is made whether an accumulated equivalent to the backward motion-vector-search range 

differential E exceeds a predetermined amount Here, the 60 denned by the boundaries x^ and x^ after compensation 

accumulated differential E is a sum of absolute values of for a difference of these inter-frame distances, 

pixel-to-pixel differentials between the frame O and the Under an assumption of do abrupt motion change, a 

frame F 2 . If the accumulated differential E exceeds the sufficient backward motion-vector-search range can be 

predetermined amount, the procedure goes to a step S7. maintained even when the backward reference frame is 

Otherwise, the procedure goes to a step S4. 65 changed from the frame F N to the frame F*, i.e. . even when 

At the step S7. the inter-frame distance N is maintained at a frame forwardly predicted based on the reference frame O 

2. This is the case where a scene change is present is changed from the frame F^ to the frame V u . This sufficient 


03/10/2004, EAST Version: 1.4.1 


5,894,526 

7 8 

backward motion-vector- search range can be maintained for search results satisfying die inequality (6) are obtained In 

any frames appearing immediately after the reference frame actuality, a requirement is that a ratio of motion vectors 

O which satisfies the inequality (5) together with the frame satisfying (he inequality (6) to all tile motion vectors 

F„. In actuality, a requirement is that a ratio of motion detected between the frame ¥ N and the frame B„ exceed a 

vectors satisfying the inequality (5) to all the motion vectors 5 predetermined threshold. As long as this requirement is met 

detected between the frame F* and the reference frame O the frame B„ can be backwardly predicted based on the 

exceed a predetermined threshold. As long as this require- frame 

ment is met the frame B„ can be backwardly predicted In this manner, whether a sufficient nwtion-vector-search 

based on the frame F^. range for bidirectional prediction can be maintained under 

Accordingly, a check as to whether the inter-frame dis- io an increased inter-frame distance is decided based on the 

tance can be increased may involve two decision making motion vectors obtained from the bidirectional prediction, 

processes. First, a check may be made whether the vector- Based on this decision, the mter-frame distance for the 

search range is sufficient for a forward prediction under an forward prediction is subjected to an increase or a decrease, 

increased inter-frame distance. Then, another check may be and. in response, the number of bi direction ally predicted 

made whether the vector-search range is sufficient for a 15 frames is increased or decreased. 

backward prediction under the increased inter-frame dis- FIG. 8 is a block diagram of an embodiment of an image 
tance. In (he flowchart of FIG. 5, for example, both of these processing device according to the present invention. The 
two checks may be made at the step S4. image processing device of FIG. 8 includes a motion- 
In this manner, whether a sufficient motion- vector-search detection unit 1. a frame memory X a first operation unit 3. 
range for bidirectional prediction can be maintained under 20 a DCT unit 4. a quantization unit 5. a variable-length coding 
an increased inter-frame distance is decided based on the unit 6. an inverse-quantization unit 7, an mverse-DCT unit 
motion vectors obtained from the forward prediction Based 8. a second operation unit 9. a frame memory 10. a local- 
oo this decision the inter-frame distance for the forward decoder unit 11, a statistical-analysis unit 12. a coding- 
prediction is subjected to an increase or a decrease, and. in patten^dclerirunation unit 13. a ccding-pattern-bascd con- 
response, the Dumber of bidirectionalry predicted frames is 25 rxol unit 14. and an analysis/determination unit 15. 
increased or decreased The frame memory 2 has a multi-bank structure to cope 
FIG. 7 is an illustrative drawing for explaining another with different: inter-frame distances which are used for 
check on a rrK>tion- vector-search range of the bidirectional detection of motion vectors. The frame memory 10 of the 
prediction according to the present invention. A check local-decoder unit 11 has two banks for storing pictures of 
shown in FIG. 7 is used in the same manner as the check of 30 the forward reference and the backward reference. The first 
FIG. 6, and provides another method of deciding whether operation unit 3 and the second operation unit 9 are in a 
the nation- vector-search range is sufficient for a bidlrec- through operation mode to pass data through when the 
tional prediction under an increased inter-frame distance. intra-frame coding is applied. When the inter-frame coding 
The same as in FIG. 4 and FIG. 6. a forward prediction is is used, the first operation unit 3 operates as a subtracter, and 
currently made for the frame Fy by using the ittference frame 35 the second operation unit 9 operates as an adder. 
O. which is provided N-frames before in a time dimension. Motion vectors detected by the caction-detection unit 1 
Also, a backward prediction of the frame B„ for the bidi- are supplied to the statistical-analysis unit 12 of the coding- 
rectional prediction is made based on the frame F^ Based on pattern-anabysis/detenniiiatioft unit 15. The statistical- 
backward-motion-vector-search results obtained between analysis unit 13 obtains statistics of the magnitude of the 
the frame F w and the frame B„. a check is made whether a 40 motion vectors. Based on the obtained statistics, the coding- 
sufficient backward motion-vector-search range is main- pattern-determination unit 13 determines a coding partem of 
rained for the bidirectional prediction of the frame B„ even pictures by deciding the inter-frame distances for 
when the forward-prediction is made for the frame F^. predictions, and notifies the coding-pattern-based control 
Under an assumption that no abrupt change is present in unit 14 of the determined coding patterns. The coding- 
picture motion, a backward prediction of the frame B„ based 45 pattern- based control unit 14 takes care of bank management 
od the frame F M requires a motibn-vector component x of the frame memory 2 according to the inter-frame dis- 
dctccted between the frame B„ and the frame ¥ N to satisfy: tances of the coding pattern. Also, the coding-pattern-based 
x ™ ^_>.,« v „«_x, «s control unit 14 is responsible for control of the first opcratioa 
l(^>W<w^)>o<l(*-*>W<A^)l (6) uni( 3 me ^4. the quantization unit 5. the variable- 

where x^ and x^ are boundaries to define the backward so length coding unit 6, the inverse-quantization unit 7. the 

inction-vectOT-search range used between the frame Bn and inverse-DCT unit 8. the second operation unit 9. and the 

the frame Here. (N-n) in the inequality (6) is the frame memory It. according to the coding pattern, 

inter-frame distance between the frame F w and the frame B,, In the case of the 1 picture, the first operation unit 3 and 

and (M-n) is the inter-frame distaace between the frame F^, the second operation unit 9 are in a through operation mode 

and the frame B,,. That is. the range defined by the inequality 35 to pass the data through. Picture information is. DCT- 

(6) on the frame F„ is equivalent to the backward motion- transformed by the DCT unit 4. is quantized by the quan- 

vector-search range defined by the boundaries x.* and x^* tization unit 5. and is coded by the variable-length coding 

on the frame F v after compensation for a difference of the unit 6 before being output from the image processing device, 

inter-frame distances. Also, the transformed and quantized picture information is 

Under an assumption of no abrupt motion change, a 60 inverse-quantized by the inverse-quantization unit 7. and is 

sufficient backward motion-vector-search range can be mverse-DCT-transformed by the invcrse-DCT unit 8 before 

maintained even when the backward reference frame is being stored in the frame memory It. 

changed from the frame F w to the frame Le.. even when In the case of the P picture, the motion-detection unit 1 

a frame forwardfy predicted based on the reference frame O reads from the frame memory 2 a previous frame in accor- 

is changed from the frame F^ to the frame F^ This sufficient 65 dance with the inter-frame distance of the forward 

backward motion-vector-search range can be maintained for prediction, and compares this previous frame with the cur- 

any frames appearing immediately after motion-vector- rent frame to obtain motion vectors within a motion-vector- 
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search range. The first operation unit 3 is controlled to work tions can be made. For example, inter-frame differences 

as a subtracter, and the second operation unit 9 is controlled between the reference frame and a frame to be predicted 

to serve as an adder. The first operation unit 3 receives each (forward prediction or bidirectional prediction) may be 

block of the current frame from the motion-detection unit 1. obtained to check the existence of a scene change. Namely, 

and receives each corresponding block of the previous frame 5 an absolute-value sum of the inter-frame differences 

from the frame memory 10 in accordance with the ejected between the reference frame and the frame to be predicted 

^;^ s - H* 6 ^ "nit 3 takes block- is obtaincd and cons ^ d with a prcdctom i ncd v £ c . ^ 

to-block differentials between the current frame and the m __ ^ A „ no ^ T~ •> 1 A ^ 

previous frame. The block-to-block differentials are coded ??J*. ? ^ ♦ f^^^™ unit 1 and the 

by the DCT unit 4. the quantization unit 5. and the variable- ift ^"ysjs unit 12. for e^ When mis sum 

length coding unit 6 to achieve inter-frame coding of the 10 CTCCe f *? P«detenmned value, mc coding-pattern-based 

current frame. The second operation unit 9 obtains a sum contro1 umt 14 controls otha elemenU so as not to 

between these differentials and the previous frame to obtain me mtCT " fniinc distances. 

a predicted current frame, which is stored in the frame Further, an absolute-value sum of differences between an 

memory 10. original frame and a prediction-resulted frame (forward 

In the case of the B picture, the axling-pattern based 13 prediction or bidirectional prediction) may be obtained and 

control unit 14 determines the number of B pictures inserted compared with a predetermined value. This may be done by 

between a P picture and one of an I picture and a P picture. the coding-pattern-based control unit 14. When this sum 

As previously described, the B picture is predicted by using exceeds the predetermined value, the coding-pattern-based 

the forwardly-predicted P picture and the reference picture* control unit 14 controls the other elements to shorten the 

which is one of an I picture and a previous P picture. In order 20 inter-frame distance between a reference frame and a frame 

to achieve this, pictures are generally provided in a partially to be predicted. In this manner, the inter-frame distance is 

reversed order at the time of coding. When a picture reduced to regain an appropriate motion-vector- search 

sequence is IIB2P3 (i.e.. a sequence of an intra picture, a range. 

bidirectionally predictive picture, and a forwardly predictive Preferably, the inter-frame distance is set at the possible 
picture), for example, an actual picture sequence for coding 23 maximum distance of the device at the start of the moving- 
is I1P3B2. Namely, a first frame is coded as an I picture picture coding of the present invention. For examples when 
based on intra- frame coding, and. then, a third frame is a forward-prediction inter-frame distance M is 3 at a raaxi- 
coded as a P picture based on forward prediction. Finally, a mum according to the capacity of the device the forward- 
second frame is coded based on bidirectional prediction by prediction inter-frame distance M should start from 3 in the 
using the I picture and the P picture. w moving-picture coding. 

In MPEG, three different modes are prepared for the FIGS. 9A through 9F are table charts for explaining the 

bidirectional prediction. A first mode is use of only the reason why the inter-frame distance should start from the 

forward prediction. A second mode is use of only the possible maximum distance. In FIGS. 9A through 9F. the 

backward prediction, and a third mode is use of both the forward-predictioQ inter-frame distance M is changed once 

backward prediction and the forward prediction. The best 35 in every 6 frames. In each table chart of FIGS. 9A through 

mode among these three mode is determined for each block, 9F the top row shows the forward-prediction inter-frame 

and is used for coding the respective block. In the following distance M. the middle row shows a sequence of I, P. and B 

description, the third mode using both the backward predic- pictures of the input picture information, and the bottom row 

tion and the forward prediction will be taken as an example shows a coded-picture sequence of L P. and B pictures. A 

for the sake of simplicity of explanation. 40 numeral after the symbol L P. or B denote the frame number. 

The frame memory 2 is controlled by the coding-pattern- For example. 10. PI. P2. P3. P4. P5. and B6 represent an I 

based control unit 14 based on the determined coding picture of frame number 1. P pictures of frame numbers 2-5. 

pattern, and (he motion-detection unit 1 searches for motion and a B picture of frame number 6, respectively, 

vectors for the forward prediction and the backward predic- FIG. 9A shows a case in which an initial inter-frame 

tic* of the bidirectional prediction. The first operation unit 45 distance for the forward prediction is 1. In FIG. 9A, the 

3 and the second operation unit 9 are WKitrolled in the same forward-prediction inter-frame distance M (hereinafter, 

manner as in the case of coding the P picture. Both banks for merely referred to as an inter-frame distance unless there is 

the forward prediction and the backward prediction are used possibility of creating confusion) is changed from 1 , 2, to 1, 

in the frame memory 10. successively. When a picture sequence of 10. PI. P2. P3. . . 

The mouon-detcction unit 1 reads from the frame memory 50 . is provided as the picture information at the start of the 

2 two reference frames for the forward prediction and the picture coding, a coded-picture sequence 10, PI. P2. P3. 

backward prediction, and compares the current frame with . is obtained with a delay of one frame period because of 

both the forward reference frame and the backward refer- processing time for coding. 

ence frame to obtain motion vectors within a raotioa-vectar- When the initial value of the inter-frame distance M is 

search range. The first operation unit 3 receives each block 55 started from 1 as shown in FIG. 9A. a coded frame is not 

of the current frame from the motion-detection unit 1. and present for a certain frame period, as shown by the symbol 

receives each corresponding block of these two reference x. Namely, in the frame period indicated by the symbol x. P7 

frames from the frame memory 10 in accordance with the should be output as a coded frame ahead of B6. but is still 

detected motion vectors. Then, the first operation unit 3 in the process of coding. This lack of the frame occurs after 

takes block-to-block differentials between the current frame 60 the inter-frame distance M is changed from 1 to 2. 

and an average of the two reference frames. The block-to- FIG. 9B shows a case in which an initial inter-frame 

block differentials are coded by the DCT unit 4, the quan- distance for the forward prediction is I. In FIG. 9B. the 

tization unit 5. and the variable-length coding unit 6 to forward-prediction inter-frame distance M is changed from 

achieve rjidirectionalfy predictive coding of the current 1. 2 to 3. successively. 

frame. 63 When the initial value of the Inter-frame distance M is 1 

The present invention is not limited to the above as shown in FIG. 9B. a coded frame is not present for a 

described embodiment, but other variations and rnodifica- certain frame period, as shown by the symbol x. This lack of 
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the frame occurs after the inter-frame distance M is changed 
from 1 to 2 and after it is changed from 2 to 3. 

FIG. 9C shows a case in which the inter-frame distance M 
is started at 2 and changed to 3. In this case, a coded frame 
is lacking during a certain frame period shown by the 
symbol x. and this occurs after the inter-frame distance M is 
changed from 2 to 3. 

FIGS. 9D through 9F show cases in which the inter-frame 
distance M is initially at the max imum distance of 3. FIG. 
9D shows a case in which the inter-frame distance M is 
changed from 3, 2. 3. 2. to 1. successively. In FIG. 9R, the 
inter-frame distance M is changed from 3. 2. 1. 2. 1. to 2. 
successively FIG. 9F shows changes of the inter-frame 
distance M from 3. 2. 1.2, 3. to 2. In these figures, a picture 

sequence of Bd, Bl, 12. B3 is provided as the picture 

information at the start of the picture coding, and a coded- 
picture sequence 12. BO. Bl is obtained with a delay of 

three frame periods because 12 should be coded first ahead 
of Bl and Bl. 

In the cases of FIGS. 9D through 9F. an initial value of the 
inter-frame distance is set to the possible maximum value, so 
that the delay of the coded-picture sequence is maximized 
from the beginning. As a result, a change in the inter-frame 
distance M does not bring about a frame period lacking a 
coded frame. FIGS. 9D through 9F show only the cases in 
which the inter-frame distance M is changed by ±1. 
However, even when the inter-frame distance M is changed 
by ±2, a mmrimum initial value of the inter-frame distance 
ensures that any frame period has a coded frame. 

Occurrence of such a frame period as having no coded 
frame does not mean that a motioo-vector-search process is 
impaired. Id the operation of the image processing device, 
however, discontinuity in the axled-frame sequence caused 
by such a frame period is undesirable in terms of the stability 
of the operation As described above, the use of the possible 
maximum value for the initial inter-frame distance ensures 
continuity of me coded- frame-ou tpu t data stream Alsa if 
image characteristics arc known or can be estimated in 
advance, the inter-frame distance may be set to a distance of 
the highest occurrence. 

As described above, according to the present invention 
used in a coding scheme employing a combination of the 
forward prediction and the bidirectional prediction, an inter- 
frame distance with an appropriate rooclon-vector-search 
range is determined based on d etected motion vectors by 
drawing on an assumed image characteristic that no abrupt 
change is present in picture motions within a short time 
period. In the case of motion vectors being small, an increase 
in the inter-frame distance is justified since an appropriate 
motion-vector-search range can be maintained after the 
increase In this case, the inter-frame distance is strecbed to 
increase the number of bidirectionaliy -predicted frames 
which have high prediction efficiency. 

Further, the present invention is not limited to these 
embodiments but various variations and modifications may 
be made without departing from the scope of the present 
invention. 

What is claimed is: 

1. A method of detecting motion vectors within a prede- 
termined search range for a motion compensation predictive 
coding, said method comprising the steps of: 

a) searching for first motion vectors between two frames 
which are separated from each other in a time dimen- 
sion by a first frame distance; 

b) selecting a second inter-frame distance in said time 
dimension of two frames between which picture motion 
is represented by second motion vectors; 


c) making a check and receiving results of whether said 
predetermined search range covers a predetermined 
percentage of said second motion vectors, said check 
using said first motion vectors as estimates of said 

5 second motion vectors after compensation for a time 
difference between said first inter-frame distance and 
said second inter-frame distance; and 

d) increasing an inter-frame time distance for detection of 
said motion vectors for said motion-compensation pre- 

10 dictive coding when warranted by the results of said 
check. 

2. A method of detecting motion vectors within a prede- 
termined search range for a motion compensation predictive 
coding, said method comprising the steps of: 

15 a) searching for first motion vectors between two frames 
which are separated from each other in a time dimen- 
sion by a first frame distance and obtaining said first 
motion vectors within said predetermined range 
between a reference frame and a forwardly-prcdicted 
frame in order to forwardly predict said forwardly- 
predicted frame; 

b) selecting a second frame distance of two frames 
between which picture motion is represented by second 
motion vectors; 

c) making a check whether said predetermined search 
range covers a predetermined percentage of said second 
motion vectors, said check using said first motion 
vectors as estimates of said second motion vectors after 
compensation for a difference between said first frame 
distance and said second frame distance; and 

d) deciding, based on results of said check, whether to 
increase a frame distance for prediction and deciding, 
based on said results of said check, whether to increase 

3S said frame distance for forward prediction from said 
first frame distance to said second frame distance. 

3. The method as claimed in claim 2. wherein said step c) 
further comprises a step of changing a scale of either said 
predetermined search range or said first motion vectors in 

40 order to achieve said compensation. 

4. The method as claimed in claim 3, wherein said step c) 
further comprises a step of changing said scale by a ratio 
between said first frame distance and said second frame 
distance. 

45 5. The method as claimed in claim 3. wherein said step c) 
comprises the steps of: 

cl) obtaining a percentage of said first vectors (x. y) 
satisfying: 


20 


25 


30 


50 


wherein N is said first frame distance, M is said second 
frame distance. x m and are horizontal boundaries of 
55 said predetermined search range, and y w and y^ arc 
vertical boundaries of said picdeterrnincd search range; and 
c2) checking whether said percentage exceeds said pre- 
determined percentage. 
6. A method of detecting motion vectors within a predc- 
60 tcrmincd search range far a motion compensation predictive 
coding, said method comprising the steps of: 
a) searching for first motion vectors between two frames 
which are separated from each other in a time dimen- 
sion by a first frame distance and obtaining said first 
65 motion vectors between a reference frame a forwardly- 
predicted frame in order to forwardly predict said 
forwardly-predicted frame; 
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b) selecting a second frame distance of two frames 
between which picture motion is represented by second 
motion vectors and selecting said second frame dis- 
tance in order to backwardly predict a bidirectionaliy- 
predictcd frame based on a backward-reference frame; 5 

c) making a check whether said pxedcterrniDed search 
range coven a predetermined percentage of said second 
motion vectors, said check using said first motion 
vectors as estimates of said second motion vectors after 
compensation for a difference between said first frame 1Q 
distance and said second frame distance; and 

d) deciding, based on results of said check, whether to 
increase a frame distance for prediction and deciding, 
based on said results of said check, whether to increase 
said frame distance for forward prediction from said ^ 
first frame distance so that a frame distance for back- 
ward prediction is increased to said second frame 
distance. 

7. The method as claimed in claim 6, wherein said step c) 
further comprises a step of changing a scale of either said ^ 
predetermined search range or said first motion vectors in 
order to achieve said compensation. 

8. The method as claimed in claim 7. wherein said step c) 
further comprises a step of changing said scale by a ratio 
between said first frame distance and said second frame M 
distance. 

9. A method of detecting motion vectors within a prede- 
termined search range for a motion compensation predictive 
coding, said method comprising the steps of: 

a) searching for first motion vectors between two frames ^ 
which are separated from each other in a time dimen- 
sion by a first frame distance and obtaining said first 
motion vectors between a backward-reference frame a 
bidirectionaUy-predicted frame in order to backwardly 
predict said bkiiirctionally -predicted frame; 3J 

b) selecting a second frame distance of two frames 
between which picture motion is represented by second 
motion vectors and selecting said second frame dis- 
tance in order to backwardly predict a bidirectio Daily- 
predicted frame based on a backward-reference frame; +q 
predctcrmiacd percentage of said second motion 
vectors, said check using said first motion vectors as 
estimates of said second motion vectors after compen- 
sation for a difference between said first frame distance 
and said second frame distance; and 43 

d) deciding, based on results of said check, whether to 
increase a frame distance for prediction and deciding, 
based on said results of said check, whether to increase 
said frame distance for forward prediction so that a 
frame distance for backward prediction is increased so 
from said first frame distance to said second frame 
distance. 

If/. The method as claimed in claim 9. wherein said step 
c) further comprises a step of changing a scale of either said 
predetermiaed search range or said first motion vectors in 55 
order to achieve said compensation. 

11. The method as claimed in claim 10, wherein said step 
c) further comprises a step of changing said scale by a ratio 
between said first frame distance and said second frame 
distance. 60 

12. The method as claimed in claim 2. further comprising 
the steps of: 

e) obtaining a percentage of said first vectors (x. y) 
satisfying: 

65 

Ny M t<*t-«Ky<N>y m JW-n) 
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wherein N is said first frame distance. M is said second 
frame distance, n is a distance between a forward-reference 
frame and a bidirectionalry-predicted frame which is to be 
backwardly predicted based on a backward-reference frame 
distanced from said forward-reference frame by said second 
frame distance, and x*** are horizontal boundaries of a 
search range for backward prediction, and y^ and y^ arc 
vertical boundaries of said search range fox said backward 
prediction; and 

f) checking whether said percentage exceeds a predeter- 
mined percentage. 

13. The method as claimed in claim 2. further comprising 
the steps of: 

e) obtaining third vectors between a backward-reference 
frame and a bidirectio nail y-predicted frame which is 
backwardly predicted based on said backward- 
reference frame and is distanced from a forward- 
reference frame by a frame distance o; 

f) obtaining a percentage of said third vectors (x. y) 
satisfying: 

wherein N is said first frame distance. M is said second 
frame distance, x^ and x^ are horizontal boundaries of a 
search range for backward prediction, and y^ and y^ are 
vertical boundaries of said search range for said backward 
prediction; and 

g) checking whether said percentage exceeds a predeter- 
mined percentage. 

14. The method as claimed in claim Z further comprising 
the steps of: 

h) obtaining a difference between a forwardly -predicted 
frame and a corresponding frame which is obtained 
based 00 a forward prediction; 

i) checking whether said difference exceeds a predeter- 
mined amount; and 

j) shortening said frame distance for said forward predic- 
tion when said difference exceeds said pre<leterinined 
amount 

15. The method as claimed in claim 2. further comprising 
the steps of: 

h) obtaining a difference between a bidirectionally- 
predicted frame and a corresponding frame which is 
obtained based on a bidirectional prediction; 

i) checking whether said difference exceeds a predeter- 
mined amount; and 

j) shortening said frame distance for said forward predic- 
tion when said difference exceeds said predetermined 
amount. 

16. The method as claimed in claim 2, further comprising 
the steps of: 

k) obtaining a difference between said reference frame 
and said forwardly-predicted frame; 

1) checking whether said difference exceeds a predeter- 
mined amount; and 

m) skipping said step c) and maintaining said frame 
distance for said forward prediction when said differ- 
ence exceeds said predetermined amount. 

17. The method as claimed in claim 2. further comprising 
the steps of: 

n) cletenrjinifig a possible maximum frame distance for 
said forward prediction: and 
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o) starting said nx>tioi>- compensation predictive coding 
by using said possible maximum frame distance for 
said forward prediction. 

18. A device for detecting motion vectors within a pre- 
determined search range for a motion compensation predic- s 
live coding, said device comprising: 

motion -detection means for searching for first motion 
vectors between two frames which are separated from 
each other in a time dimension by a first inter-frame 
distance; 10 

analysis-and-determination means fox selecting a second 
inter-frame distance in a time dimension of two frames 
between which picture motion is represented by second 
motion vectors, and for making a check and receiving 
a result of whether said predetermined search range 13 
covers a predetermined percentage of said second 
motion vectors, said check using said first motion 
vectors as estimates of said second motion vectors after 
compensation for a time difference between said first 
inter-frame distance and said second inter-frame dis- 20 
tance; 

control means for controlling, based on the results of said 
check, a change in an inter-frame distance for detection 
of said motion vectors for said motion-compensation ^ 
predictive coding. 

19. A device for detecting motion vectors within a pre- 
determined search range for a motion compensation predic- 
tive coding, said device comprising: 

motion-detection means for searching for first motion 30 
vectors between two frames which are separated from 
each other in a time dimension by a first frame distance 
and for obtaining said first motion vectors between a 
reference frame and a forwardfy -predicted frame in 
order to forwardty predict said forwardly-predicted 35 
frame; 

analysis-and-oetermination means for selecting a second 
frame distance of two frames between which picture 


motion is represented by second motion vectors, and 
for making a check whether said predetermined search 
range covers a predetermined percentage of said second 
motion vectors, said check using said first motion 
vectors as estimates of said second motion vectors after 
compensation for a difference between said first frame 
distance and said second frame distance; and 

control means for controlling, based on results of said 
check, a change in a frame distance for prediction and 
for increasing said frame distance for forward predic- 
tion from said first frame distance for forward predic- 
tion from said first frame distance to said second frame 
distance based on said results of said check. 

26. A device for detecting motion vectors within a pre- 
determined search range for a motion compensation predic- 
tive coding, said device comprising: 

motion-detection means for searching for first motion 
vectors between two frames which are separated from 
each other in a time dimension by a first frame distance; 

anary sis-and-deterrai nation means for selecting a second 
frame distance of two frames between which picture 
motion is represented by second motion vectors, and 
for making a check whether said predetermined search 
range covers a predetermined percentage of said second 
motion vectors, said check using said first motion 
vectors as estimates of said second motion vectors after 
compensation for a difference between said first frame 
distance and said second frame distance and for making 
a check whether a search range for backward prediction 
is sufficient after said frame distance for said forward 
prediction is increased, said check using said first 
motion vectors as estimates of motion vectors used in 
said backward prediction. 
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